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Abstract 

We study the transients of linear max-plus dynamical systems. For that, we consider for 
each irreducible max-plus matrix A, the weighted graph G{A) such that A is the adjacency 
matrix of G{A). Based on a novel graph-theoretic counterpart to the number-theoretic Brauer's 
theorem, we propose two new methods for the construction of arbitrarily long paths in G{A) 
with maximal weight. That leads to two new upper bounds on the transient of a linear max-plus 
system which both improve on the bounds previously given by Even and Rajsbaum (STOC 1990, 
Theory of Computing Systems 1997), by Bouillard and Gaujal (Research Report 2000), and by 
Soto y Koelemeijer (PhD Thesis 2003), and are, in general, incomparable with Hartmann and 
Arguelles' bound (Mathematics of Operations Research 1999). With our approach, we also show 
how to improve the latter bound by a factor of two. 

A significant benefit of our bounds is that each of them turns out to be linear in the size of 
the system in various classes of linear max-plus system whereas the bounds previously given are 
all at least quadratic. Our second result concerns the relationship between matrix and system 
transients: We prove that the transient of an iV x matrix A is, up to some constant, equal 
to the transient of an A-linear system with an initial vector whose norm is quadratic in N. 
Finally, we study the applicability of our results to the well-known Full Reversal algorithm 
whose behavior can be described as a min-plus linear system. 
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1 Introduction 



The mathematical theory of linear max-plus dynamical systems provides tools to understand the 
complex behavior of many important distributed systems. Of particular interest are transportation 
and automated manufacturing systems [H El [3] , or network synchronizers [4j . As shown by Charron- 
Bost et al. [5], another striking example is the Full Reversal distributed algorithm which can be 
used to solve a variety of problems like routing ^ and scheduling |7j. The fundamental theorem 
in max-plus algebra — an analog of the Perron-Probenius theorem — states that the powers of an 
irreducible max-plus matrix become periodic after a finite index, called the transient of the matrix 
(see for instance [8]). As an immediate corollary, any linear max-plus system is periodic from some 
index, called the transient of the (linear) system, which clearly depends on initial conditions and 
is at most equal to the transient of the matrix of the system. 

For all the above mentioned applications, the study of the transient plays a key role in char- 
acterizing their performances: For example, in case of Full Reversal routing, the system transient 
corresponds to the time until the routing algorithm terminates in a destination oriented routing 
graph. Besides that, understanding the matrix and system transient is of interest on its own for the 
theory of max-plus algebra. While the transients of matrices and linear systems have been shown 
to be computable in polynomial time by Hartmann and Arguelles [9], their algorithms provide no 
analysis of the transient phase, as they both use (binary) search at heart, and by that do not hint 
at the parameters that influence matrix and system transients. Conversely, upper bounds involving 
these parameters would help to predict the duration of the transient phase, and to define strate- 
gies to reduce the transient as well. Hence concerning transience bounds, our contribution is both 
numerical and methodological. 

The problem of bounding the transients has already been studied: Bouillard and Gaujal |10] 
have given an upper bound on the transient of a matrix which is exponential in the size of the 
matrix, and polynomial bounds have been established by Even and Rajsbaum [1] for linear systems 
with integer coefficients, by Soto y Koelemeijer [11] for both general matrices and linear systems, 
and by Hartmann and Arguelles [9] for general matrices and linear systems in max-plus algebra. 
In each of these works, the problem of studying the transient is reduced to the study of paths in a 
specific graph: For every max-plus matrix A, one considers the weighted directed graph G whose 
adjacency matrix is A, and the critical subgraph of G which consists of the critical closed paths in G, 
namely those closed paths with maximal average weight. The periodic behavior of the powers of A 
is intimately related to the structure of the critical subgraph of G: Bounding transients amounts to 
bounding the weights of arbitrary long paths in the graph. The first step in controlling the weights 
of paths consists in reaching the critical subgraph with sufficiently long paths. With respect to this 
first step, the methods used in the four above-mentioned transience bounds are rather similar. The 
approaches mainly differ in the way the critical subgraph is then visited. 

In this article, we propose two new methods, namely the explorative method and the repetitive 
method for visiting the critical subgraph. The first one consists in exploring the whole strongly 
connected components of the critical subgraph whereas in the second one, the visit of the critical 
subgraph is confined to repeatedly follow only one closed path. That leads us to two new upper 
bounds on the transients of linear systems which improve on the bounds given by Even and Rajs- 
baum and by Soto y Koelemeijer, and are incomparable with Hartmann and Arguelles' bound, for 
which we show how to improve it by a factor of two. 

A significant benefit of our bounds lies in the fact that each of them turns out to be linear in the 
size of the system (i.e., the number of nodes) in some important graph families (e.g., trees) whereas 
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the bounds previously given are all at least quadratic. This is mainly due to the introduction of 
new graph parameters that enable a fine-grained analysis of the transient phase. In particular, we 
introduce the notion of the exploration penalty of a graph G as the least integer k with the property 
that, for every n k divisible by the cyclicity of G and every node i of G, there is a closed path 
starting and ending at i of length n. One key point is then an at most quadratic upper bound on 
the exploration penalty which we derive from the number-theoretic Brauer's Theorem [12j. 

Another contribution of this paper concerns the relationship between matrix and system tran- 
sients: We prove that the transient of an x matrix A — which is clearly an upper bound on 
all transients of j4-linear systems — is, up to some constant, equal to the transient of an A- linear 
system with an initial vector whose norm is quadratic in A^. In addition to shedding new light 
on transients, this result provides a direct method for deriving upper bounds on matrix transients 
from upper bounds on system transients. 

The paper is organized as follows. Section [2] introduces basic notions of graph theory and max- 
plus algebra. We show an upper bound on lengths of maximum weight paths that do not visit the 
critical subgraph in Section [3l In Section HJ we introduce the notion of exploration penalty and 
improve a theorem by Denardo [13] on the existence of arbitrarily long paths in strongly connected 
graphs. Sections [5] and El introduce our explorative and repitive bounds, respectively. We show how 
to convert upper bounds on the transients of max-plus systems to upper bounds on the transients 
of max-plus matrices in Section [Tl We discuss our results, by comparing them to previous work 
and by applying them to the analysis of the Full Reversal algorithm, in Section [HI 

2 Preliminaries 
2.1 Basic definitions 

Denote by M the set of nonnegative integers and let M* = M \ {0}. Let Umax = K. U {— oo}. In this 
paper, we follow the convention max0 = — oo. 

A (directed) graph G is a pair (V,E), where F is a nonempty finite set and E Q V x V . We 
call the elements of V the nodes of G and the elements of E the edges of G. An edge e = {i,j) is 
called incident to node k \i k = i or k = j. We say that G is nontrivial if E is nonempty. 

A graph G' = iy' , E') is a subgraph of G if C 1/ and E' C E. For a nonempty subset E' 
of E^ let the subgraph of G induced by edge set E' be the graph {V',E') where V = {i £ V \ 3j £ 

V:{i,j)eE'w{j,i)eE'}. 

A path TT in G is a triple vr = (Start, Edges, End) where Start and End are nodes in G, Edges is 
a sequence (ei, 62, . . . , e^) of edges e; = {ii,ji) such that ji = if 1 ^ / ^ n — 1 and, if Edges is 
nonempty, ii = Start and jn = End, and if Edges is empty, Start = End. We say that vr is empty 
if Edges is empty. We define the operators Start, Edges, and End on the set of paths by setting 
Start(7r) = Start, Edges(7r) = Edges, and End(7r) = End. Define the length ^(vr) of vr as the length 
of Edges(7r). 

Let V{i, j, G) denote the set of paths vr in G with Start(7r) = i and End(7r) = j, and by 7^(2 —>, G) 
the set of paths vr in G with Start(7r) = i. If vr G V{i,i^G), we say that i is the start node of vr 
and j is the end node of vr. We write V"{i,j, G) (respectively P'^(i— )•, G)), where n ^ 0, for the set 
of paths in V{i,j,G) (respectively V{i^,G)) of length n. Path vr is closed if Start(vr) = End(vr). 
Let Vc){G) denote the set of nonempty closed paths in graph G. 

Path vr is elementary if the nodes ii are pairwise distinct. Intuitively, an elementary path visits 
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at most one node twice: its start node. All elementary paths vr satisfy ^(vr) ^ \V\. A path is simple 
if it is elementary and non-closed, or empty. Intuitively, a path is simple if it does not visit the 
same node twice. All simple paths vr satisfy i(7r) ^ |y| — 1. 

Call G strongly connected ifV{i, j, G) is nonempty for all nodes i and j of G. A subgraph H ofG 
is called a strongly connected component of G if is maximal with respect to the subgraph relation 
such that H is strongly connected. Denote by C{G) the set of strongly connected components of G. 
For every node i of G there exists exactly one H in C{G) such that i is a node of H. 

For two paths tt and tt' in G, we say that tt' is a prefix o/vr if Start(7r) = Start(7r') and Edges(7r') 
is a prefix of Edges(7r). We say that vr' is a postfix of n if End(7r) = End(7r') and Edges(7r') is a 
postfix of Edgcs(7r). We call tt' a subpath of vr if it is the postfix of some prefix of vr. Wc say a 
node i is a node of path tt if there exists a prefix n' of tt with End(7r') = i, and an edge e is an edge 
of path TT if e occurs within Edges(7r). For two paths tti and 7r2 with End(7ri) = Start(7r2), define 
the concatenation vr = vri ■ 7r2 by setting Start(7r) = Start(7ri), Edges(7r) = Edges(7ri) • Edges(7r2) 
and End(7r) = End(7r2). 

We define the girth g{G) and circumference cr{G) of G to be the minimum resp. maximum 
length of nonempty elementary closed paths in G. Define the cab driver's diameter cd{G) of G to 
be the maximum length of simple paths in G. The cyclicity of G is defined as 

c{G) = 1cm { gcd{£(7) \7eVoiH)}\He C{G)} . 

For a strongly connected graph G, the cyclicity c{G) is the greatest common divisor of closed path 
lengths in G; in particular c{G) ^ giG) ^ \V\. Wc say that G is primitive if c{G) = 1. A graph is 
primitive if and only if all its strongly connected components are primitive. We also define the two 
graph parameters 

d{G) = maK{c{H) \ H € C{G)} 

and 

p{G) = lcm{£(7) I 7 G Vo{H) A 7 is elementary} . 
It is d{G) < c{G) i^p{G). 

Lemma 1. Let tt be a path in G. Then there exist paths tti, 1^2 and an elementary closed path 7 
such that 7r = vri • 7 • 7r2 . Moreover, if tt is non-simple, then 7 can be chosen to be nonempty. 

Proof. The first claim is trivial, for we can choose 7ri = vr, and 7 and 7r2 to be empty. 

So let 7r be non-simple. Then tt is necessarily nonempty. If tt is elementary closed, set 7 = tt 
and choose 7ri and 7r2 to be empty. Otherwise, let Edges(7r) = (ei, . . . ,e„) and = (i/, j/). By 
assumption, there exist k < I such that ik = ii and I — k is minimal. Now set Edges(7ri) = 
(ei, . . . , efc_i), Edges(7) = {e^, ■ ■ ■ , e/_i), Edges(e;, . . . , e„), and choose the start and end nodes 
accordingly. Closed path 7 is elementary, because I — k was chosen to be minimal. □ 

An edge-weighted (or e-weighted) graph G is a triple {V, E, we) such that {V, E) is a graph and 
WE : — )■ R. An edge-node-weighted (or en-weighted) graph G is a quadruple {V,E,we-,wv) such 
that (F, i?. We) is an e-weighted graph and wy '■ V Umax- 

If G = (F, i?, we-,wv) is an en-weighted graph and tt is a path in G with Edges(7r) = (ei, . . . , e„), 
we define the en-weight of tt as 

n 

'^{'^) = ^^E(ez) -I- u;y(End(7r)) , 

1=1 
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and, if G is just an e- weighted graph, the e- weight of tt as 

n 

1=1 

Let = max{u'(7r) \ n £ V'''{i^,G)}. 

In the rest of the paper, every notion introduced for graphs (resp. e-weighted graphs) is trivially 
extended to e-weighted graphs (resp. en-weighted graphs) using the same terminology and notation. 

2.2 Realizers 

Let N be any nonempty set of nonnegative integers, and let i be any node of a strongly connected 
e-weighted graph G. A path n is said to be an N-realizer for node i if tt € V{i^, G), ^(tt) € N, and 
w{Tr) = sup„g]vf u'"(i^). Obviously, an N-realizer exists for any node if N is finite. Of particular 
interest is the case of sets N of the form 

N^^'^ = {nGlN|n^n A n = r (mod p)} , 

where r G IN, and p,h IN*. The following lemma gives a useful sufficient condition in terms of 
N^^^-realizer to guarantee the eventual periodicity of the sequence {'^^''i'^^)) ^eJN' 

Lemma 2. Let i be a node and let p and h be positive integers. Suppose that for all n ^ n, there 
exists a ISi^-^^f^ -realizer for i of length n. Then t(;"+*'(i— >) = w"'{i^) for all n ^ h. 

Proof. For each integer n ^ n, let 7r„ be one N^^^-realizer for i of length n. Denote by X{n) the 
set of paths tt in V{i^) that satisfy ^(tt) = n (mod p) and -^(vr) ^ n, and let x{n) be the supremum 
of values w{'k) where tt G X{n). Since N^'^^'' has a realizer, each x{n) is finite, and x{n) = w{'Kn)- 
From n + p = n (mod p) , it follows 

X{n + p) = X{n) 

and so x[n+p) = x{n). For all n ^ n, we have V^{i^) C X{n), i.e., w^{i^) ^ x{n). As n+p > n, 
we also conclude that it;"'+P(i— >) ^ x{n + p). Because 7r„ G V^{-^ j), we have w''^{-^ j) ^ w{'Kn)- 
Similarly, u;"+p(— > j) > wijin+p)- This concludes the proof. □ 

2.3 The critical subgraph 

Let G = (y, E, We) be a nontrivial strongly connected e-weighted graph. Define the rate q{G) of G 

by 

^(G) = sup|^|7GPo(G)} , 

which is easily seen to be finite. A (nonempty) closed path 7 G Vo{G) is critical if w^{'j)/£{'y) = 
q{G). a node of G is critical if it is node of a critical path in G, and an edge of G is critical if 
it is an edge of a critical path in G. The critical subgraph of G, denoted by Gc, is the subgraph 
of G induced by the set of critical edges of G. A critical component of G is a strongly connected 
component of the critical subgraph of G. 

Wc denote by A(G) (respectively (5(G)) the maximum (respectively minimum) edge weights 
in G. Let Anc(G) denote the maximum weight of edges between two non-critical nodes. If no 
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such edge exists, set A^dG) = q{G). Note that 5{G) ^ q{G) ^ A(G) always holds. Denote the 
non- critical rate of G by 

Qnc{G) = sup < , I 7 G Vo{G) A 7 has no critical node 

with the classical convention that Qnc{G) = —oo. if no such path exists. 

We now study how the critical graph and the various parameters introduced above are modified 
by homotheties. Let A be any element in IR, and let A®G denote the e- weighted graph \®G = 
(y, E, X^we) where for any edge e G E 

X(S>WE{e) = WE{e) + A . 

Lemma 3. The e-weighted graph A^G has the same critical subgraph as G, and its rate is equal 
to 0{X0G) = q{G) + X. 

Proof. If w^{tt) and A(8)t(;^=(7r) denote the respective e- weights of path vr in G and X^G, then we 
have the equality A(8)zi;*(7r)/£(7r) = W:^{7r)/i{7r) + A, which implies Q{X(dG) = g{G) + X. The equality 
(A(8>G)^ = Gc now easily follows. □ 

From Lemma [3l we easily check that each of the parameters A(G) — g{G), Anc(G) — g{G), and 
S{G) — q{G) is invariant under homothety: 

Lemma 4. Let G be an e-weighted graph, and A an element in R. //'A(8>G denotes the e-weighted 
graph obtained by adding A to each edge weight of G, then A(A(8'G) — ^^(A^G) = A(G) — q{G), 
Anc(A0G) - q{X®G) = Anc(G) - q{G), and 6{X®G) - q{X®G) = 6{G) - q{G). 

We next show that critical closed paths exist by showing that q{G) is equal to the supremum 
of the finite set of w^:{'~f)/i{'~f) where 7 is a nonempty elementary closed path. Define 

Qe{G) = sup 1^^^^ I 7 € Po(G) A 7 is elementary I . 

Lemma 5. Let a,b,c,d be real numbers, b and d positive, such that a/b ^ c/d. Then: 

a a + c c 

- ^ ^ - 

b b + d d 

Proof. We have ad ^ be and thus 

a + c 1 ab + bc 1 ab-\- ad a 
b + d ~ b ' b + d ^ b ' b + d ~ b ' 

Analogously, 

a + c 1 ad + cd ^ 1 bc + cd c 
b + d~d b + d ^d b + d ~d' 
which concludes the proof. □ 

Lemma 6. For every nontrivial strongly connected e-weighted graph G, 

giG) = ge{G) . 

In particular, there exists an elementary critical closed path in G. 
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Proof. Obviously, ge{G) ^ q{G). 

Conversely, we show by induction on £(7) that tt'*(7)/^(7) ^ Qe{G) for all nonempty closed 
paths 7 in G. The case £(7) = 1 is trivial, because every closed path of length 1 is elementary. Now 
let £(7) > 1. If 7 is elementary, we are done by the definition of Qe{G). If 7 is non-elementary, it 
is non-simple. Thus, by Lemma [U there exist tti, 7r2, and an elementary nonempty closed path 7' 
such that 7 = TTi -7' •7r2. It is End(7ri) = Start(-7r2), hence 7" = vri •7r2 is a closed path. Furthermore, 
£(7') < £(7) because 7' 7^ 7, and ^(7") < ^(7) because 7' is nonempty. 

We obtain 

^ max< , , , , - /■ ^ ^el.'-rj 



£(7) £(7') +^(7") I ^(7') ' ^(7") 

by Lemma [5] and the induction hypothesis. Thus we have shown q{G) ^ Qe{G). 

The last statement follows because the set of nonempty elementary closed paths is finite. □ 

The following is a well-known fact in max-plus algebra: 

Lemma 7. Let G he a nontrivial strongly connected e-weighted graph. Then every nonempty closed 
path in Gc is critical in G. 

Proof. Set Q = q{G). Let vr be a nonempty closed path in Gc with Edges(7r) = (ei,...e„). By 
definition of Gc, all edges ei = {ii,ji), 1 ^ I ^ n, are critical, i.e., there exists a path 7; G Vo{G) 
with 

w*{li)/^{li) = Q . (1) 

and whose last edge is ei. For each /, 1 ^ / ^ n, construct 7^' from 7^ by removing its last edge. 
Thus 7;' is a path with Start(7P = ji and End(7;) = ii. Concatenation of the paths 7^ yields a 
closed path 7' = 7^ • 7^_i 7i- From ([T|) follows 

w*H) + WE{ei) = Ql{ii) + Q . 

Summing over all / yields 

w*(7') + w*(vr) = £'£(7') + q(.{ti) . 
Combination with q(.{'^') ^ w*{l') gives 

if*(vr) ^ £'^(7r) , 

hence vr is critical. □ 
2.4 Linear max-plus systems 

A matrix with entries in Umax is called a max-plus matrix. We denote by M.m,n{X) the set of 
M X N matrices with entries in X. If ^ G MM,NO^max) and B € MN,Qi^max), define B € 
max) by setting 

{A (g) B)ij = max{Aj_fc + Bkj | 1 ^ A; ^ iV} . 
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The identity element in the monoid (A^Ar,Ar(Ilmax), 'SS'), denoted [0]n, is the matrix whose diagonal 
entries are equal to and all other entries are equal to — oo. More generally, for any A G IR-max; the 
matrix whose diagonal entries are equal to A and all other entries are equal to —oo is denoted by 
[X]n. If ^ G A^iv,7v(lRmax), define = [0]n, and = A O for n ^ 1. For convenience, 

the matrix [AJtv (8) ^ is simply written A (8) ^; more generally, for any positive integer n, the matrix 
([A] at)®" (g) A, whose (i, j)-entry is Aij + An, is simply written A®" (8> A. 

For a matrix A G M. Ar,Ar(IIlmax) and a vector v G Umax' define the linear max-plus system xa,v 
by setting 

If for n = 

XA,v['n') = < (2) 
\A0XA,v{'n' — l) for n ^ 1 . 

Clearly XA,vin) = v. 

Denote by G{A) the e-weighted graph with nodes {1,2,..., A^} containing an edge (i, j) if and 
only if Aij is finite, and set its edge weight WE{i,j) = Aij. Observe that with the notation in the 
previous Section, G(A ^ A) = X^G{A). 

Denote by G{A, v) the en-weighted graph defined in the same way as G{A) with node weights 
set to wvii) = Vi. Call A irreducible if G{A) is strongly connected and nontrivial. 

The following correspondence between the sequence {A'^"{n))n^Q (respectively the sequence 
XA,v) and weights of paths in G{A) (respectively G{A,v)) holds: 



Lemma 8. For all matrices A G A^Ar,Ar(IR-max) all v G IR: 



N 

max? 



(yl®"),^j. = max{u;*(7r) | ^ G {iJ,GiA))} and 
(^®"®f)i = max{«;(7r) \ tt e {i^,G{A,v))} = w''{i^,G{A,v)) . 

We simply denote {A'^"')ij by AfJ in the sequel. 

We define the cyclicity of A, denoted by c{A), as the cyclicity of the critical subgraph of G{A), i.e, 

c{A)=c{Gc{A)) ■ 

The main result on max-plus matrices is an analog of the Perron-Frobenius theorem in linear 
algebra. 

Theorem 1 ([8, Theorems 2.9 and 3.9]). An irreducible matrix A G M.N,N{^raax) has exactly one 
eigenvalue q{A) equal to the rate of the e-weighted graph G{A), i.e., 

g{A) = 0{G{A)) . 

Moreover, there exists an integer h such that for every n ^ fi: 

Using the classical operators "+" and "•" , the above equality is equivalent to: 
Vi,i G {1, ■ ■ ■ , iV} : = + c{A)giA) . 
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2.5 Eventually periodic sequences 

Let X be any nonempty set. A sequence / : IN ^ ^R-max is eventually periodic if there exist p G M*, 
Wp S Umax) and € W such that 



Mn^ Up : f{n + p) = f{n) + m 



where Wp stands for the constant function that maps any element in X to Wp. Such an integer p 
is cahed an eventual period (or for short a period) of /. Theorem [1] shows that c{A) is a period of 
both sequences and [x A,v{n)) 

We denote by Pj the set of periods of /. Clearly Pj is a nonempty subset of IN closed under 
addition. Let pq = minPj be the minimal period of /; hence pqM* ^ P/- As po G P/) there exist 
wq G Rmax and no € IN such that 

Vn ^ no : /(n +p) = f{n) + wq . 

Let p be any period of /, and p = apQ + b the Euclidean division of p hy pq. For any integer 
n ^ max{np, no — 6}, 

/(n + p) = f{n) + Wp = f{n + b) + awo . 

It follows that either 6 = or 6 is a period of /. Since b ^ pq — 1 and po is the smallest period of /, 
we have 6 = 0, i.e., po divides p. Then we derive that P/ C polN*. 

For any period p = qpo of /, let Ug be the smallest positive integer such that 

Vn ^ ng : /(n + qpo) = f{n) + qujQ . 

The integer Ug is called the transient of f for period p. 

Lemma 9. For any positive integer q, n^ = ni. 

Proof. Since for any n ^ ni, 

/(n + qpo) = f{n) + qwo, 

we have n^ ^ ni. 

We now prove that Ug = ui by induction on (7 € IN*. 

1. The base case g = 1 is trivial. 

2. Assume that Ug = ni. For any integer n ^ ng+i, 

/(n +{q + l)po) = /(n) + {q+ l)wo. 
Moreover, \i n + pQ ^ Uq then 

/(n+ {q+ 1)pq) = f{n + po) +pwo. 
It follows that for any integer n ^ maxjn^ — po,ng+i}, 

f{n + Po) = f{n) + wo. 

Hence ni ^ maxjn^ — pO) ^g+i}) and by inductive assumption ni ^ maxjni — poj'^g+i}- Then 
we derive ni ^ n^+i, and so ni = n^+i as required. □ 
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It follows that the transient for period p of a periodic sequence is independent of p. We hence 
simply call it the transient of f. 

Theorem [J states that c{A) = c(Gc(A)) is a period of the sequence A^^. Because p{A) = 
p(^G{A)) is a multiple of c{A), also p{A) is a period. We find it more convenient in our proofs to 
consider p{A) as the period instead of the period c{A) suggested by Theorem [TJ 

Let A € Mn,n(M max) be an irreducible matrix and let v G IR^g^x- We call the transient 
of the sequence the transient of matrix A, denoted by ha, and the transient of the 

sequence (^XA,vin-)) the transient of system xa,v, denoted by ua^v Obviously, ua is an upper 
bound on the transient of the xav^s, i.e., 



SUp{nA,,;|^^ € E-max} ^ ^A ■ 



Conversely, the equalities 



AfJ = (^®"®e^')^ 
where = if i = j and e;^ = — oo otherwise, show that 



max {n^ \j G {1, • • • , N}] ^ ua 



Hence, 



sup {nA,v\v € IR-max} = "^A ■ (3) 

The transients are invariant under homotheties: 

Lemma 10. For all irreducible matrices A G A^Ar,Ar(IR.max), o-H vectors v € E-max; ^'^'^ A G R, 
we have the equalities of transients nx^^A = "^a and nx^A,v = ^a^v 

Proof. The lemma follows immediately from the equalities 
and 

(A O A)®" ® w = A®" (^®" O v) . 

□ 

2.6 Reduction to the case of a zero rate 

Let G = {V,E,we) be a nontrivial strongly connected e-weighted graph. Since q{G) G IR, we 
may define the e-weighted graph G = {—q{G))(^^G. By LemmaO G and G have the same critical 
subgraph, and 

0(G) = . 

Similarly, for any irreducible max-plus matrix A, we denote A = {—g{A))0A, and we have 

g(A) = . 

Moreover, Lemma S] gives: 

A(G) = A(G) - 0{G), Ane(G) = A^,{G) - q{G), 6{G) = 6{G) - q{G) , 
which are respectively denoted A(G), Anc(G), and S{G). From g{G) = 0, we easily deduce that 

5{G) ^ ^ A(G) . 

The point of the reduction to a zero rate is evidenced by the following lemma: 
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Lemma 11. Let N be any nonempty set of nonnegative integers, and let i be any node of a strongly 
connected e-weighted graph G such that g{G) = 0. Then there exists an 'N-realizer for node i. 

Proof. By Theorem [1] and the fact that q{G) = 0, the supremum is taken over a finite set. Hence 
it is a maximum. □ 

3 Visiting the Critical Subgraph along Optimal Paths 

In this section, we give an upper bound on lengths of paths with maximum weight containing 
no critical node. For that, we first describe how to extract a simple path from an arbitrary path. 

3.1 Our first path reduction 

In this section, we construct from a path vr its simple part Simp(7r) by repeatedly removing 
nonempty closed subpaths. Each step of this construction corresponds to applying Lemma [TJ 
As the decomposition in this lemma is not unique, we choose the to-be-removed closed subpath 
non-deterministically. Formally, we fix a global choice functior0 which we use every time we "choose 
an X in X" . 

Let G be a graph and let vr be a path in G. By Lemma [H there exist paths vri, 7r2 and a 
closed path 7 such that vr = tti • 7 • 7r2. Because End(vri) = Start(vr2), the concatenation vri • vr2 is 
well-defined. If vr is non-simple, then we choose 7 to be nonempty, i.e., £(vri • vr2) < ^(vr). 

We define Step(vr) to be the concatenation vri •vr2. If ^r is simple, then Step(vr) = vr. Furthermore, 
we define 

Simp(vr) = lim Step*(7r) . 

i— )-CXD 

The construction of Simp(7r) takes a finite number of (at most ^(vr)) steps, hence Simp(vr) is well- 
defined. Since Step(vr) = vr if and only if vr is simple, Simp(vr) is simple. Finally, vr and Step(vr), 
and so vr and Simp(vr), have the same start and end nodes, respectively. We call Simp(vr) the simple 
part of vr. 

3.2 Tiie critical bound 

Lemma 12. Let G be a nontrivial strongly connected en-weighted graph and let tt be a path in G 
whose nodes are non- critical. Then, 

w{tt) ^ u;(Simp(7r)) + f?„c(G)- (£(7r) - ^(Simp(vr))) . 

Proof. It suffices to show the inequality with Step(vr) instead of Simp(7r). 

If Step(vr) = vr, then the inequality trivially holds. Otherwise, let 7 be the nonempty closed 
path in the definition of Step(vr). Then w{7r) = 7i;(Step(vr)) + w*(7). By assumption, 7 is a 
nonempty closed path whose nodes are non-critical, hence w^i^j) ^ Qnc{G) ■ ^{l)- Noting £(7) = 
^(vr) — ^(Step(vr)) concludes the proof. □ 

We introduce some additional notation for a en- weighted graph G: Let cdnc{G) be the length 
of the longest simple path in G whose nodes are noncritical, and let crc{G) be the length of the 

^We could also restrict the universe of possible nodes to a given set U and explicitly state a choice function. 
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longest elementary critical closed path in G. We define 



\wv\\ = maxwyu — mmwyu 



Analogously to IIilivII, we define for vectors v G Umax- 

\\v\\ = max Vi — min Vi 

To enhance readability and since no confusion can arise, we omit the dependency on the graph G 
in the next definition: 

D ■ J , , \\wv\\+ ^ncCdnc-Scd llwll +AncCdnc-5(iVnc + Crc-l)l 

Bc(G) = mm <^ cdnc -\ — , — > , (4) 

where A'nc is the number of non-critical nodes of G. 

Theorem 2. Let G be a nontrivial strongly connected en-weighted graph and let i be a node of G. 
For all n ^ Bc{G), there exists a path of maximum en-weight in 'P"'{i^, G) that contains a critical 
node. 

Proof. Since a path is of maximum en- weight in V"'{i^,G) if and only if it is of maximum en- 
weight in 'P"'{i^,G), the critical nodes in G and G are the same, and Bc{G) = Bc{G), we may 
assume without loss of generality, that q{G) = in the following. 
Let Anc = Anc(G), 5 = S{G), and ^^c = ■^nc(G'). 

Now suppose by contradiction that there exists an n ^ Bc{G) such that all paths of maximum 
weight in V^{i^,G) are paths with non-critical nodes only. Let vr be a path in 'P"{i^,G) of 
maximum weight with non-critical nodes only. 

Next choose a critical node k and a prefix vTc of Simp(7r), such that the distance between k and 
End(7rc) is minimal. Let tt2 be a path of minimum length from End(7rc) to k. Further let 7 be a 
critical elementary closed path with Start(7) = End(7) = k. Choose m G IN to be maximal such 
that i{7rc) +£{712) +m- £{'-/) ^ n and choose vri to be a prefix of 7 of length n— {^i{TTc)+i{7T2)+m-i{'y)) . 
Clearly Start(7ri) = k. If we set n = tTc • 1^2 • 7"^ • tti, we get ^(vr) = n and for the weight of tt in G, 

w{7t) ^ mmwvij) + w^{tTc) + w*(vr2) + ^^^(vri) . (5) 
jeV 

Figure [1] illustrates path vr. 

Let TTa be a path such that Simp(7r) = vTc • tt^. By Lemma [T2] we obtain for the weight of tt in G, 

w{tt) ^ u'(Simp(7r)) +^„c-(^(7r) - ^(Simp(7r))) 

^ maxwvij) +w^{7rc) + w^iiTs) + gn^-(£{7r) - £{7rc) -^(vrs)) (6) 

By assumption w{7r) > w{'it), and from ([5]), ([6]), and 'g^^ < we therefore obtain 

m < M+M^3)-_M^i)-Mn2) ^ ^ 

6nc 

< llw||+A„.^(vr3)_-^fflvr,)+^(vr,)) ^ ^^^^^ ^ ^^^^^ 
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Figure 1: Path vr in proof of Theorem [2] 



From d?]) we may deduce, 

^ \\wv\\+ ^nccdncjG) -6cd{G) 
(.{ir) < — h cdnc[Cr) ■ (8) 

Snc 

Alternatively we may deduce from ^ with —'Qnc ^ ^{'^2) + ^(^ra) + ^(vTc) ^ Nnc, and 
i{TTi) ^ crc(G) - 1 that 

||w|| + A„ccdnc(G)-5(Ar„c + crc(G)-l) 
£(7r) < . (9j 

Combination of dS]) and Q yields a contradiction to n ^ Bc{G). The lemma follows. □ 

Even and Rajsbaum [H Lemma 10] and Hartmann and Arguelles [9l Claim in proof of Theo- 
rem 10] arrived at analog bounds for critical nodes on maximum weight paths. A comparison of 
these bounds is given in Section 18.11 

From Theorem [2] together with cdnc{G) ^ N — 1 and N^c + cfc{G) ^ A^, and Lemma [4] we 
immediately obtain: 

Corollary 1. Let G he a nontrivial strongly connected en-weighted graph with N nodes and let i 
be a node of G. For all 

„ . llwll + (Anc(G)-^(G))(A-l) 
there exists a path of maximum en-weight in 'P"'{i—^,G) that contains a critical node. 



4 Arbitrarily Long Closed Paths 

We introduce for a strongly connected graph G the exploration penalty of G, ep{G), as the smallest 
integer k such that for any node i and any integer n ^ k that is a multiple of c(G), there is a 
closed path of length n starting at i. We prove that ep{G) is finite, and we give an upper bound on 
ep{G) which is quadratic in the number of nodes of G. As we see in the subsequent sections, the 
exploration penalty plays a key role to bound the transient as it constitutes a threshold to "pump" 
path weights inside the critical graph. 
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4.1 A number-theoretic lemma 

We now state a useful number-theoretic lemma, which is a simple application of Brauer's Theo- 
rem [12]. 

Let N be any nonempty set of integers. Any nonempty subset A C N is said to be a gcd- 
generator of N if gcd(A) = gcd(N). Note that, as 1i is Noetherian, any nonempty set of integers 
admits a finite gcd-generator. 

Lemma 13. A set N of positive integers that is closed under addition contains all but a finite 
number of multiples of its greatest common divisor. Moreover, if {ai, . . . ,ak} is a finite gcd- 
generator of N with oi ^ . . . ^ Ofc, then any multiple n ofd = gcd(N) such thatn ^ d{^ — — 1) 
is in N. 

Proof. Consider the set M of all the elements in N divided by d = gcd(N). By Brauer's Theo- 
rem [12j, we know that every integer (^ — 1)(^ — 1) is of the form 

k 

1=1 

where each Xi is a nonnegative integer. Since N is closed under addition, it follows that every 
multiple of d that is greater or equal to d{^ — 1)(^ — 1) is in N. In particular, all but a finite 
number of multiples of d are in N. □ 

4.2 Constructing long paths 

In the case G = (F, E) is a primitive graph, Denardo [13] established the following upper bound 
on ep{G): 

Lemma 14 (Denardo, [13^ Corollary 1]). Let G be a strongly connected primitive graph with N 
nodes and of girth g. For any integer n ^ N + {N — 2)g and any node i of G, there exists a closed 
path starting at i of length n. 

In |14] . we prove that the same upper bound actually holds for any (primitive or non-primitive) 
strongly connected graph. We now show that we can obtain a better upper bound on ep{G) in the 
case of non-primitive graphs from the number-theoretic lemma in Section 14.11 For that, we first 
recall some well-known properties on the lengths of paths in a strongly connected graph. Let Njj 
be the subset of integers defined by: 

Nij = {n G IN I Bvr e V{i,j,G), n = ^(vr)}. 

Clearly each Nj^j is closed under addition; let di = gcd(Nj^j). Obviously, 

c{G) = gcd({d, I i G V}). (10) 

Lemma 15. For any node i in G, di = c{G). Moreover, for any pair of nodes i,j, all the elements 
in Njj have the same residue modulo c{G). 
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Proof. Let i,j be any pair of nodes, and let a € Njj and b G Nj,j. The concatenation of a path 
from i to j with a path from j to i is a closed path starting at i. Hence a+b G Nj^j. From Lemma [T3| 
we know that Njj- contains all the multiples of dj greater than some integer. Consider any such 
multiple kdj with k and di relatively prime integers. By inserting one corresponding closed path 
at node j into the closed path at i with length a + b, we obtain a new closed path starting at i, 
i.e., a + kdj + b € Nj^j. It follows that di divides both a + b and a + kdj + b, and so di divides dj. 
Similarly, we prove that dj divides di, and so di = dj. By pOj) . the common value of the dj's is 
actually equal to c{G). 

Let a and a' be two integers in Njj. The above argument gives both a + b and a' + 6 in Nj^j. 
Hence c{G) divides a + b and a' + b, and so a — a'. □ 

Lemma 16. For any node i of G, the set Nj^j admits a gcd-generator which contains all the lengths 
of elementary closed paths starting at i, and whose all elements n satisfy the inequality 

5 ^ n ^ 2iV - 1 

where g is the girth of G and N is the number of nodes in G. 

Proof. Let i be any node of G, and let 70 be any elementary closed path. Let tti be one of the 
shortest paths from i to 70, and let j = End(7ri). Without loss of generality. Start (70) = j. By 
definition, £{tti) ^ A^ — £(70). Then consider a simple path 7r2 from j to i, and the two closed paths 

TT = TTl ■ TT2 and Vr' = VTl • 70 • 712 ■ 

Note that 

£{7r) ^ e{Tr') ^ 2iV - 1 

and ^(vr) ^ g, because vr is closed. In the particular case i is a node of 70, vr' reduces to 70, and so 
£{it') is the length of the elementary closed path 70. 

Let Nj be the set of the lengths of the closed paths vr and vr' when considering all the elementary 
closed paths 70 in G. Then, Nj contains all the length of elementary closed paths starting at i. 
Let gi = gcd(Nj). Since Nj C Nj^j, di divides gi. Conversely, let 70 be any elementary closed path, 
and let tt and vr' be the two closed paths starting at node i defined above; gi divides both £(vr) and 
^(vr'), and so divides ^(vr') — £(vr) = ^(70)- Hence, gi divides the length of any elementary closed 
path, i.e., gi divides c{G). By Lemma[T5l it follows that gi divides di. Consequently, gi = di, that 
is to say Nj is a gcd-generator of Nj^j. □ 

Lemma 17. Let G be a strongly connected graph with N nodes, of girth g and cyclicity c. For any 
node i of G and any integer n such that n is a multiple of c and n ^ 2Ng/c — g/ c — 2g + c, there 
exists a closed path of length n starting at i. 

Proof. Let i be any node, and let 70 be any elementary closed path such that -^(70) = g- Let vri 
be one of the shortest paths from i to 70, and let j = End(vri). Without loss of generality, 
Start(7o) = j. By definition, £(vri) ^ N — g. Then consider an elementary path vr2 from j to i; we 
have £(vr2) ^ — 1. The path vri • vr2 is closed at node i, and so c divides £(vri) +^(vr2). Hence, if c 
divides some integer n, then c also divides n — ^(vri) — ^(vr2). It is (7 G By Lemma [Ml there 

exists a gcd-generator Nj of Nj j- such that g G Nj and g ^ n ^ 2N — 1 for all n G Nj . 
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By Lemma [T3l for any n such that n' = n — ^(vri) — ^(712) is a multiple of c and 



/g \ f2N - 1 
n'^c 1 



there exists a closed path 7 starting at node j of length £(7) = n' . Note that 

c(^-l) f^^-l)+(iV-,) + (iV-l) = 2^iV-^-2, + c. 

In this way, for any integer n ^ 2N g / c — g / c—2g + c that is a multiple of c, we construct tt = vri •7-7r2 
that is a closed path at node i of length n. □ 

We easily check that the upper bound on ep{G) given by Lemma[T7]is better than the generalized 
Denardo bound [14j, except when c = 1, since then 2 ^ c ^ g holds in the theorem below. 

Theorem 3. Let G be a strongly connected graph with N nodes, of girth g and cyclicity c. The 
exploration penalty of G, denoted ep, is well-defined and satisfies the inequality 

ep ^ 2-N - - -2g + c 
c c 

which can he improved to 

ep^N + {N - 2)g 

in case G is a primitive graph. 



5 Explorative Bound 

In this section, we show a bound on the transient ua^v of linear max-plus systems for irreducible 
matrices A and vectors v with only finite entries, i.e., v G R^. We construct arbitrarily long paths 
by exploring a critical component H in the sense of Section we hence call the resulting bound the 
explorative hound. As we did in Section HI we distinguish the cases of whether the critical subgraph 
is primitive or not: If c{H) = 1, we can find critical closed paths in H of arbitrary length t ^ ep{H); 
otherwise, it is only possible to find critical closed paths of length t if c{H) divides t. We start with 
the case of a primitive critical subgraph in Section 15.21 because it allows for a simpler proof, as we 
do not have to consider the constraint that critical closed path lengths in critical component are 
necessarily multiples of c{H). 

5.1 Outline of the proof 

We now show how to establish an upper bound B[A, v) on the transient of the sequence (yl®" ®v)i 
having the properties that (i) B{A,v) is greater or equal to the critical bound Bc[G{A,v)^ and (ii) 
B{A,v) is invariant under substituting A by A. By Lemmata [3l and [TOl and property (ii), it suffices 
to establish the upper bound in the case g{A) = 0. Let B = B{A, v). 

First, we take any N^^^^-realizer vr for node i in en- weighted graph G = G{A,v); realizer tt 
exists by Lemma [TTl By property (i) and Theorem [2l we know that we can choose vr to contain a 
critical node k. Depending on k, we choose a modulus d dividing In Section TS.Sl we introduce 
a path reduction — a generalization of the simple part of a path — that preserves the residue class of 
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the reduced path, i.e., i{Tr) = ^(vr) (mod d) where vr is the reduced path of n. We apply our path 
reduction Red^^fc to tt, obtaining path vr. Lemma [20] in Section 15.31 shows that the length of vr is 
less or equal to some bound B^edid). Further, A: is a node of vr and w{-k) ^ w{7r). 

We then show that, for arbitrary multiples t of d such that t ^ B — Bjiedid), there exist critical 
closed paths starting at k of length t. It follows that for all n ^ B, there exists an N^^^-realizer 7r„ 
for i of length n. Application of Lemma [2] then concludes the proof. 



5.2 The case of primitive critical subgraphs 

For a nontrivial strongly connected en-weighted graph G with primitive critical subgraph, define 

Be(G) = max|Sc(G) , 2 • cd{G) + max ep{H) I . 

Lemma 18. Let G he a nontrivial strongly connected en-weighted graph with primitive critical 
subgraph and q{G) = 0; let B = Bc{G) and p = p{G). For all nodes i and all n ^ B exists an 
l>i^^^ -realizer for i of length n. 

Proof. By Lemma [TT| there exists an N^^^^-realizer vr for i. By Theorem [2l we can choose vr to 
contain a critical node k, because B ^ Bc{G). Let vr = tti • 7r2 with End(7ri) = k. 

Set TTi = Simp(7ri) and ■K2 = Simp(7r2). Because g{G) = 0, it is QnciG) ^ 0, and hence 
'w^{Tfi) ^ w<t:{TTi) and w{7r2) ^ w{-K2) by Lemma [T2l The lengths of tti and n2 satisfy £{7ri) ^ cd{G) 
and 1{t:2) ^ cd{G), because the paths are simple. 

Let H G C{Gc) be the strongly connected component of Gc in which critical node k is contained. 
Note that H is primitive, i.e., c{H) = 1. Thus, for all t ^ ep{H) there exists a critical closed path jt 
of length t starting at node k. 

By Lemma [71 w^^'ft) = q{G) = 0, and hence 

w{t[i ■ 7j • 71-2) = w*(7ri) + w*(7t) + w{t:2) ^ w^:{'ni) + w{t:2) = w{it) . (11) 

Further, ^(vri • jt ■ vrz) = £(7ri) + £{112) + t. 

We set t = n - (^(vri) + ^(71-2)) ^ B -2- cd{G) ^ ep{H) and 7r„ = ^"1 • 7f • 7r2. Figure [2] depicts 
path 7r„. It follows that ^(7r„) = n and w(7r„) ^ t(;(7r). Hence, because n ^ B and Start(7r„) = 
Start(7r) = i, vr^ is an N^^^^-realizer for i of length n. □ 

Theorem 4. For aZ/ irreducible A G A^Ar,iv(Ilmax) swc/i that Gc{A) is primitive, and all v G R^, 
we have nA,v ^ -Be(G(A, . 

Proof. By Lemma[Tniand Lemma[31 both n^^„ and Be(G{A,v)^ are invariant under substituting A 
by A. We may hence assume without loss of generality that q{A) = 0, i.e., q(G{A,v)^ = 0. 

Let B = Bf,{G{A.,v)^ . Graph G{A.,v) is nontrivial and strongly connected, because A is irre- 
ducible. By Lemma [TSl for every node i and every n G n|^^\ there exists an N^^^^-realizer for i of 
length n. Lemma [2] hence implies that the transient of sequence (?i;"'(i— )-))^ in graph G{A,v) is at 
most B. But, by Lemma[8l the transient of (t(;"(i— )-))^ in G{A,v) is equal to ua^v This concludes 
the proof. □ 
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Figure 2: Realizer 7r„ in proof of Lemma [T8l 

Corollary 2. For all irreducible A € AlAr,Ar(IIlmax) such that Gc{A) is primitive, and all v G R^, 

we have 

j \\v\\ + {A^,{G)-6{G))-{N-l) \ 
nA,v < max < ^ — , 2 • (iV - 1) + max ep{H) } , 

[ Q{G) - Qnc{G) H€C{Gc) J 

where G = G{A) . 

5.3 Our second path reduction 

In the case that the critical subgraph is not primitive, i.e., if there exist critical components H 
with c{H) > 1, our first path reduction — the simple part of a path — is not sufficient for us, because 
we can no longer choose a critical path 7^ in H of arbitrary length t ^ ep{H), but only of lengths 
that are multiples of c{H). In this section, we thus introduce a generalization of our first path 
reduction Simp(7r), which is able to preserve the residue class modulo c{H) of the path lengths. 
The idea is to repeatedly remove collections of closed subpaths of vr whose combined length is a 
multiple of c{H). 

The generalized path reduction, Redrf^fc(7r), has two additional parameters: a modulus d and a 
node k of vr. The reduction is defined in such a way that (a) the reduced path's length is in the 
same residue class modulo d as path tt's length, and (b) node A: is a node of the reduced path. Our 
first path reduction is a special case of this second path reduction when setting d = 1 and k to be 
the start node of vr. 

Let G be a graph and let vr be a path in G. Let 5 be a finite multiset of subpaths of tt. We say 
that S is disjoint if there exist paths uo, cti, . . . , (T„ such that 

TT = (To • TTl ■ (Tl • • • 7r„ • (Tn (12) 

where S = {■ki,'K2, ■ ■ ■ ^T^n}- 

For a disjoint multiset S of closed subpaths of vr, define 

Rem(7r, S) = uq ■ ai ■ ■ ■ an 

where the ai are chosen to fulfill Equation (I12p . The paths vr and Rem(7r,5) have the same start 
and end nodes, respectively. Furthermore ^(Rem(7r,5)) = £{tt) — L{S) where L{S) = J2-yes ^('y)- 
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In particular, Rem(7r,5) = vr if and only if L{S) = 0. Hence if Rem(7r,5) 7^ tt, then necessarily 
£(Rem(7r,5)) < 

For a path tt and a node k of vr, denote by Sfc(7r) the set of disjoint multisets S of elementary 
closed subpaths of tt such that /c is a node of Rem(7r, S). For a path tt, a node of vr, and a positive 
integer d, define 

Sd,fc(^) = {5 G Sfc(^) [ L{S) = (mod d)} . 

This set is never empty, because is a node of vr and we can hence choose <S to be empty. 
Choose S € Srf^fc(7r) such that L{S) is maximal. Then set Step^fc(7r) = Rem(7r,5) and 

Redd.fc(7r) = lim Step^fc(7r) . 

The construction of Jiedd^ki'^) takes a finite number of (at most ^(vr)) steps, hence Hedd^ki'^) is 
well-defined. It is Redd^fc(7r) = vr if and only if L{S) = for all <S G Srf^fc(7r). The paths vr and 
Redrf^fc(vr) have the same start and end nodes, respectively. Also, /c is a node of Red^^ ^(vr) and 

^(Redd,fc(vr)) = £(vr) (mod d) . 

Finally, whenever G is an en-weighted graph with g{G) = 0, t(;(Rem(vr, 5)) ^ u'(vr), because we 
repeatedly remove closed subpaths. 

The following lemma is a well-known elementary application of the pigeonhole principle. Erdos 
attributed it to Vazsonyi and Sved. [15, p. 133] 

Lemma 19. Let d be a positive integer and let xi,...,Xd € Then there exists a nonempty 
I C {1, . . . , d} such that 

Xj = (mod d) . 

Proof. For 1 ^ A; ^ d, set = Z]i=i ^i- there exist k < £ with = (d), then set 
/ = {k + l,k + 2, . . . ,£}. Otherwise the mapping k 1-^ {Sk mod d) is injective, hence surjective 
onto {0, 1, ... ,d — 1}, which implies that there exists a /cq with S^q = {d). In this case, set 
I = {l,2,...,ko}. □ 

With the help of Lemma \T9\ we can prove the following upper bound on the length of the 
reduced path Red^^ki'^) ■ 

Lemma 20. Let G be a graph with N nodes. For all positive integers d, all nodes k, and all paths vr 
that contain node k, 

£(Redd,fc(vr)) ^ (d - 1) • cr{G) + {d+l)- cd{G) . 

Proof. Write vr = Redrf^fc(vr). Let S £ Sk{Tt) such that L{S) is maximal. Further, let S be the 
sub- multiset of the nonempty closed paths of «S. It is L{S) = L{S). Because <S G Sfc(vr) and S C S, 
it follows that S € Sk^Tr)- 

We first show that |5| ^ d — 1: Otherwise, by Lemma [T9l there exists a nonempty S' C 
S with L{S') = J^'yeS' ^("f) = ^ (mod d); hence S' G Srf^fc(vr) with L{S') > 0, a contradiction 
to Red(i^fc(vr) = vr. We have thus proved 

|5[ ^ d- 1 . (13) 
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Every 7 G 5 is elementary, therefore ^(7) ^ cr{G) and thus 

L{S) ^ (d- 1) •cr(G) . (14) 
Let n = \S\, S = {71, . . . ,7^}, and 

TT = CTq • 7l • CJi • • • 7„ • CJ„ . 

Because A; is a node of Rem(7r,5), there exists an r such that A; is a node of Ur- Figure [3] shows this 
decomposition of path vr. 




Figure 3: Path vr in proof of Lemma [20l 

If m 7^ r, then we show that am is simple: Otherwise by Lemma [H there exists a nonempty 
elementary closed subpath 7' of am- But then S' = S \J {7'} S Sfc(7r), because A: is a node of ar 
and m 7^ r; a contradiction to maximality of L{S), because L[S') > L(S). Hence 

i{am) ^ cd{G) for m / r . (15) 

We now show that i{ar) ^ 2 • cd[G): Let = ttq • vri with End(7ro) = k. Then ttq and vri are 
simple, because otherwise, if 7^ is a nonempty elementary closed subpath of vr^, t G {0, 1}, then 
5' = 5 U {7^} € Sfe(7r), because A; is a node of tti-i] a contradiction to the maximality of L{S), 
because L{S') > L{S). We have thus proved that 

i{ar) ^ 2 • cd{G) . (16) 

We note that n = |5| ^ d — 1 by (I13p . Thus combination of (I15p and (I16p yields 

n 

Y,^M ^ ((i + l)-c(i(G) , (17) 

m=0 

which, in turn, yields by combination with ()14p : 

n 

£{tt) = L{S) + cr{G) + {d+l)- cd{G) 

m=0 

This concludes the proof. □ 
5.4 Extension to the general case 

In this section, we generalize the explorative bound to the case of a not necessarily primitive critical 
subgraph. For that, we use the generalized path reduction Redrf^fc(7r). 
For a nontrivial strongly connected en-weighted graph G define 

Be{G) = max \ Bc{G) , {d{Gc)-l) ■cr{G) + {d{Gc) + l) ■cd{G)+ max ep{H)\ . 

This definition generalizes the previous definition of Bc{G), which was stated for the case of a 
primitive critical subgraph. 
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Lemma 21. Let G he a nontrivial strongly connected en-weighted graph with g{G) = 0; let B = 
Be{G) and p = p{G). For all nodes i and all n ^ B exists an ISf^^^^ -realizer for i of length n. 

Proof. By Lemma W\\ there exists an N^^''-realizer vr for i, i.e., vr E P{i^) is of maximum weight 
such that ^(vr) ^ B and ^(tt) = n (mod p). By Theorem [2l we can choose vr such that there is a 
critical node k on vr, because B ^ Bc{G). Let G C{Gc) be the critical component of /c. 

Set TT = Redc(//)^fc(7r). It is £{Tf) = £{77) {c{H)) and also ^(vr) = n {c{H)), because c{H) 
divides p{G). Hence i{7r) = n (c{H)), i.e., there exists an integer m such that n = £{%) + m ■ c{H). 
It follows from Lemma [20l and c{H) ^ d{Gc) that m • c(-fr) = n — ^ ep{H); in particular, m 
is nonnegative. Hence, by Lemma \T7\ there exists a closed path 74 of length t = m ■ c{H) in 
starting at node k. By LemmaO z«*(7i) = q{G) = 0. 

Let vr = TTi • -^"2 with End(7ri) = A; and set vr^ = vri • 7^ • 7r2. Path 7r„ has the same form as in 
Figured Then ^(7r„) = ^(vr) + ^(7t) = n and 

w{T:n) = tL)*(7ri) + w^^ijt) + ^(712) = ^^(vri • 112) = w{tt) ^ ty(7r) . 

Hence, because Start(7r„) = Start(7r) = i, 7r„ is an N^^^-realizer for i of length n. □ 

Theorem 5. For all irreducible A G A^Ar,Ar(IK.max) ^J'^'^ ^^^^ S I^^; /zave n^^^, ^ B(,(^G{A,v)^ . 

Proof. By LemmaHOland LemmaHj both nA,v and i?e(G(A, u)) are invariant under substituting A 
by A. We may hence assume without loss of generality that g{A) = 0, i.e., ^(^(^4,1;)) = 0. 

Let B = Bc[G{A,v)) and p = p{G). Graph G{A,v) is nontrivial and strongly connected, 

because A is irreducible. By Lemma [211 for every node i and every B, there exists an N^J'''- 
realizer for i of length n. Lemma [2] hence implies that the transient of sequence >-))^ in 

graph G{A,v) is at most B. But, by Lemma [51 the transient of )■)) in G{A,v) is equal 

to 

n'A,v This concludes the proof. D 
Corollary 3. For all irreducible A E A^Ar,Af (IR-max) 'I'^d all v € R^, we /lave 

i \\v\\ + (A^JG) - 6(G)) ■ (N - 1) , , , , ,1 

n^,. ^ max <^ ^ ^ '-j^ , {d - I) + 2d ■ {N - I) + max ep i7 } , 

where G = G{A) and d = d{Gc). 



6 Repetitive Bounds 

In Section [5l we explored critical components H in the sense of Section [H to construct critical 
closed paths whose lengths are multiples of c{H). We now follow another approach, which yields 
better results in some cases: We do not explore anymore critical components, but instead consider 
a single (elementary) critical closed path 7 starting at critical node k, and repeatedly add 7 to the 
constructed paths; we hence call the resulting bounds repetitive. We present two repetitive bounds: 
one using our path reduction Red^^fc in Section [6. 1[ and an improvement of the bound of Hartmann 
and Arguelles [9] by a factor of two in Section 16.21 
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6.1 Our repetitive bound 



This section presents the bound we get when substituting the exploration of the visited critical 
component by only using a single elementary critical closed path in the method used to derive the 
explorative bound. The proof follows the same outline as described in Section 15.11 In the resulting 
upper bound on the transient, we substitute c{H) by ^(7), and thus substitute d{Gc) by cr(Gc), 
and drop the exploration penalty terms ep{H). It is of course possible that cr{Gc) is strictly greater 
than d{Gc)- 

For a nontrivial strongly connected en-weighted graph G define 



Lemma 22. Let G he a nontrivial strongly connected en-weighted graph with q{G) = 0; let B = 
By-{G) and p = p{G). For all nodes i and all B exists an ISi^^^ -realizer for i of length n. 

Proof. By Lemma [TT| there exists an N^^''-realizer vr for i, i.e., vr E ?>) is of maximum weight 
such that ^(vr) ^ B and ^(vr) = n (mod p). By Theorem [21 we can choose vr such that there is a 
critical node k on vr, because B ^ Bc{G). Let 7 E C{Gc) be an elementary critical closed path 
starting at k. 

Set TT = Red^(^)^fc(7r). It is £{-k) = £{tt) {i{'y)) and also i^n) = n (^(7)), because £(7) di- 
vides p{G). Hence £(7r) = n (^(7)), i.e., there exists an integer m such that n = 1{t:) + m ■ ^(7). 
Lemma [20] and ^(7) ^ cr[Gc) implies ^(vr) ^ B, hence m is nonnegative. 

Let vr = TTi • 7r2 with End(7ri) = k and set tt^ = vri • 7™ • tt2- Figure [H depicts path vTn. Then 
^(TTn) = (-{t^) + rn ■ ^(7) = n. Further, w{'Kn) = w{t:) ^ w{tt) and Start(7r„) = Start(7r) = z, i.e., 7r„ 
is an N^^^-realizer for i if length n. □ 



B,{G) = max<^ B^{G) , (cr(Gc) - l) • cr{G) + {cr{Gc) + l) • cd{G) 





P 



Figure 4: Realizer 7r„ in proof of Lemma [22] 



Theorem 6. For all irreducible A G A^Ar,Ar(lR-max) cind all v € R^, we have nA,v ^ Br(^G{A,v)) . 

Proof. By Lemma[TU]and Lemma[ll both nA,v and B^{^G{A,v)^ are invariant under substituting A 
by A. We may hence assume without loss of generality that g{A) = 0, i.e., g[G{A,v)^ = 0. 
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Let B = Bj.(^G{A,v)^ and p = p{G). Graph G{A,v) is nontrivial and strongly connected, 
because A is irreducible. By Lemma [22l for every node i and every n ^ B, there exists an N^J'''- 
realizer for i of length n. Lemma [2] hence implies that the transient of sequence )-))^ in 

graph G{A,v) is at most B. But, by Lemma El the transient of [w"'{i^))^ in G{A,v) is equal 
to 

n'A,v This concludes the proof. D 
Corollary 4. For all irreducible A € at, at (Umax) 0''nd all v € R^, we have 

nA,v ^ max <^ — , [cr - 1) + 2cr ■ [N - 1) } 

[ eiG) - Qnc{G) J 

where G = G{A) and cr = cr{Gc)- 

6.2 Improved Hartmann-Arguelles bound 

In Corollary HI the second term in the maximum is bounded by 2N'^ . Hartmann and Arguelles also 
arrived at the term 2N'^ in the corresponding part of their upper bound on the transient of a max- 
plus system [9l Theorem 12]. To prove this upper bound, Hartmann and Arguelles used a different 
kind of path reduction, which we recall in Theorem [7] below. This path reduction guarantees that 
the reduced path is in the same residue class modulo ^(7), the length of some visited critical closed 
path 7. 

Hartmann and Arguelles, after reducing a realizer with their path reduction, combine elemen- 
tary critical closed paths in the visited critical component to arrive at the right residue class 
modulo c(Gc). However, this construction is not necessary, for it is not necessary to consider c{Gc) 
as the period, as we have shown in Section [2.51 We can improve on their proof by considering p{G) 
as the period, which is a multiple of c{Gc)- Avoiding the construction saves one time A^^ in the 
resulting bound; hence the second term in the maximum can chosen to be N"^ instead of 2A^^, as 
we show now. 

Theorem 7 ([9, Theorem 4]). Let G be an e-weighted graph with N nodes and q{G) = 0. Let vr G 
V{i,j,G) with ^(vr) ^ A^^ and let k be a critical node 0/ vr. Further, let "y be a critical closed 
path starting from k. Then there exist a path tt € V{i,j,G) such that i^n) = £{tt) (mod ^(7)), 
w^:{'k) ^ w^:{it), k is a node of -k, and i{Tr) < N'^. □ 

For a nontrivial strongly connected en-weighted graph G with A^ nodes define 

B^^{G) = max {B^iG) , N^} . 

Lemma 23. Let G be a nontrivial strongly connected en-weighted graph with g{G) = 0; let B = 
B^^{G) and p = p{G). For all nodes i and all B exists an 'N^^'j^'^ -realizer for i of length n. 

Proof. By Lemma [TT| there exists a N^^'* -realizer vr for i, i.e., vr € V{i^) is of maximum weight 
such that ^(vr) ^ B and £(7r) = n (mod p). By Theorem [2l we can choose vr such that there is a 
critical node k on vr, because B ^ B^- Let 7 be an elementary critical closed path starting at k. 

Let vr be as in Theorem [7] and let li = lii ■ 112 with End(vri) = k. It is ^(vr) = (.{-k) (mod ^(7)) 
and also £(vr) = r (mod ^(7)), because £(7) divides p{G). Hence ^(vr) = n (mod ^(7)), i.e., there 
exists an integer m such that t = m- £(7) = n — ^(vr). It is £(vr) < A^^ ^ B, hence m is nonnegative. 

Setting vr„ = TTi • 7™ • 7r2 yields ^(vr„) = n and ty(vr„) = w{-k) ^ w{tt). This concludes the 
proof. □ 
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Theorem 8. For all irreducible A € MN,N{^max) md all v G R^, we have ua^v ^ (G). 

Proof. By LemmafTOland LemmafU both n^^v and B^^(^G{A, v)) are invariant under substituting A 
by A. We may hence assume without loss of generality that g{A) = 0, i.e., g[G{A,v)) = 0. 

Let B = B^^(^G{A,v)) and p = p{G). Graph G{A,v) is nontrivial and strongly connected, 

because A is irreducible. By Lemma [23l for every node i and every B, there exists an N^^^- 
realizer for i of length n. Lemma [2] hence implies that the transient of sequence (tu'^(i — t-))^ in 
graph G{A,v) is at most B. But, by Lemma [HI the transient of in G{A,v) is equal 

to 

n-A,v This concludes the proof. D 
Corollary 5. For all irreducible A € A4N,N{Rma.x) and all v G R^, we have 

"^'^^"'^"l giG)-g^.{G) ' / ' 

where G = G{A). 



7 Matrix vs. System Transients 

To obtain an upper bound on the transient of a max-plus matrix, we can follow the same idea as in 
Sections El El and El and substitute AfJ and G) for . and G) in the proofs. 

This leads to an upper bound in 0((A — 6) ■ N"^ /{g — ^?nc))i but gives no hint on the relationships 
between the transient of a max-plus matrix A, and the transients of the max-plus systems xa,v In 
this section, we show that up to some constant B^/s{G), the transient of matrix A is actually equal 
to the transient of some specific systems xa,v where \\v\\ is in 0((A - 6) ■ N^) . Combined with the 
general upper bounds on the system transient established in Theorems El El or El this result gives 
upper bounds on the matrix transient, each of which is also in 0((A — 6) ■ N"^ /{g — £'nc)) • 

First, we derive a general property of strongly connected graphs from the definition of explo- 
ration penalty. 

Lemma 24. Let G be a strongly connected graph. For any pair of nodes i,j of G and any integer 
n ^ ep{G) + c{G) + cd{G) — 1, there exists a path tt from i to j such that n — £{Tr) S {0, • • • , c{G) — 1}. 

Proof. Let i,j be any two nodes, and let ttq be a simple path from i to j. For any integer n, 
consider the residue r of n — ^(vro) modulo c{G). By definition of ep{G), if n — ^(vro) — r ^ ep{G), 
then there exists a closed path 7 starting at node j with length equal to n — ^(vro) — r. Then, ttq ■ 7 
is a path from i to j with length n — r, where r G {0, • • • , c{G) — 1}. The lemma follows since 
n — ^(vTo) — r ^ ep{G) as soon as n ^ e.p{G) + cd{G) + c{G) — 1. □ 

Lemma 25. Let A € at, at (Umax) irreducible, G = G{A), and let n be any integer such that 
n ^ ep{G) + c{G) + cd{G) - 1. Then = _oo if and only if AfJ = -00. 

Proof It is equivalent to claim that V+''^'^\i,j,G) = if and only if V{i,j,G) = for any 
integer n ^ ep{G) + c{G) + cd{G) - 1. 

Suppose / 0, and let ttq G V+^^^Xi, j,G). By Lemma [Ml there exists a path 

TT G V{i, j, G) such that n = £(7r) -|- r with r G {0,1,..., c{G) — 1}. Lemma [15l implies that c{G) 
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divides ^(vro) — ^(vr) = (n + c(G)) — (n — r) = c{G) + r; hence c{G) divides r. Therefore, r = 0, i.e., 
£(^) = n and thus / 0. 

The converse imphcation is proved similarly. □ 

We now define the matrix/system bound for graph G by 

Bm/siG) = 2cd(G) + ep(G) + max c(H) + max ep(H) - 1 
' HeC{Gc) HeC{Gc) 

and let 

fi{A) = sup {Afj: - AfJ \i,j,k^V,n-^ B^,,{G{A)), Af;^ + -oo} . 

Obviously, /i G Emax- 

In the following lemma, we fix a node j G V, and a vector € such that 

ykeV\{j}, Vj-Vk^fi . (18) 
Such a vector v exists, and we let x = xa,v 

Lemma 26. Let A € Mn,n i^max) irreducible and G = G{A). For any integer n ^ B,^/s{G), any 
node i, and any positive integer p that is a multiple ofc{G), if Xi{n+p) = Xi{n), then Af^^'^ = Af^. 

Proof. Let i be any node in G, and n be any integer such that n ^ Bj^/^{G). Since B^i^{G) ^ 
ep{G) + c{G) + cd{G) — 1, and c{G) divides p, we derive from Lemma [25] that AfJ~^^ = — oo if and 
only if AfJ = — oo. There are two cases to consider: 

L AfJ = -oo and AfJ^^ = -oo. In this case, AfJ^^ = AfJ trivially holds. 

2. AfJ ^ -oo, and AfJ+^ / -oo. Recah that 

Xi{n) = max {.4®^" + Vk \ k e {1, ■ ■ ■ , N}} . 
By definition of /i and v, for any node k ^ j, 

Since the latter inequalities trivially hold for k = j, it follows that 

x,{n) = AfJ + v, . 

As n + p ^ n, we also have 

AfJ^P = Xi{n + p)- = Xi{n) - Vj = AfJ . 

Thus AfJ+'P = AfJ holds in this case. 
The lemma follows in both cases. □ 
Lemma 27. Let A € Mn,n (Rmax) be an irreducible max-plus matrix, and let G = G{A). Then 
p{A) ^ A(G) • cd{G) - 6{G) ■ {2cd{G) + ep{G) + max c{H) - l) . 
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Proof. First observe that 

Hence each term in the inequahty to show is invariant under substituting G by G, and we may 
assume without loss of generahty that q{A) = 0. It fohows that 

6{G) ^ < A(G) . 

Then we prove that 

Af^^ ^ A(G) • cd{G) . (19) 

If Af^J^ = -oo, then ([H]) trivially holds. Otherwise, Af^J! = t(;*(7r) for some path vr G V{i,k,G), 
and 

u'*(7r) ^ 'u;,(Simp(^)) s: A(G) • cd{G) . 

We now give a lower bound on Af^ in the case that it is finite, i.e., if V"'{i,j,G) ^ 0. Let u 
be a critical node, in critical component H, with minimal distance from i and let tti be a shortest 
path from i to u. Further, let 7r2 be a shortest path from u to j. Let r denote the residue of 
n — i^TTi ■ 112) — ep{G) modulo c{H), and let t = n — ^(vri • 112) — ep{G) — r. Since t = (mod c{H)), 
and 

i ^ ^m/s - 2cd{G) - ep{G) - c{H) + 1 ^ ep(F) , 

there exists a closed path 7c of length t in component H starting at node u. Let s = ep{G) + r; 
then, s ^ ep{G). Moreover, s = n — ({tti ■ 7c • vr2), and vri • 7c • 7r2 € V{i,j,G). By Lemma [151 it 
follows that c{G) divides s. Hence there exists a closed path 7„c of length s starting at node j. 
Now define tt = tti • 7c • 712 • 7nc- Figure [5] shows path vr. Clearly, £{-k) = n and 

w^{^)^5-{n-t)^5- (2cd(G) + ep(G) + c{H) - l) , 



and so 




Figure 5: Path vr in proof of Lemma [271 

From Lemma [27] with cd{G) ^ iV — 1 and c{H) ^ N we immediately obtain: 
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Corollary 6. Let A G A^Ar,Ar(]Rmax) be an irreducible max-plus matrix, and let G = G{A). Then 
^i[A) ^ (A(G) - 5{G)) ■{N-l) + {q{G) - 5{G)) ■ {2{N - 1) + ep[G)) . 
For an irreducible matrix A G at, at (Umax) and j, with 1 ^ j ^ A^, we define vector by: 



Vfc G V, vl 



\ik = j 

—fi{A) otherwise . 



Theorem 9. Let A € Mn.n max) be an irreducible max-plus matrix and G — G{A). Then 

HA ^ max{Sm/s(G) , n^y , n^^^iv} . 

Proof. We easily check that each vector satisfies condition ([H]), and \\v^\\ = /J-iA). Since c{G) 
divides c(^), we can apply Lemma [26] with all vectors and p = c[A^. Then, we obtain 

Vn G W : n ^ max{i?j„/g(G) , ,^1 , • • • , "ra^^^jv} n ^ , 

which shows 

UA ^ max{Sni/s(G) , n^^„i , n^^^iv} . 

□ 

Hence up to -Bm/s) the transient of an irreducible matrix A is equal to the transient of some of 
the systems {A,v^). Interestingly, this result could be compared to the equality 

UA = maxjnyi gi , ■ ■ ■ , giv} 

established in Section [2.51 where e^ denotes the vector in IR^ax which is similar to vector except 
the j'th component equals to —00 instead of —fi{A). 

Combination of Theorem [9] and Corollary [6] finally yields: 

Corollary 7. Let A G AlAr,Ar(lIlmax) be an irreducible max-plus matrix and G = G{A). Then 

HA < max {3{N - 1) + ep{G) + max ep{H) , B{G)] , 

HeC{Gc) 

where B{G) is the minimum of the bounds stated in Corollaries\^^ andO with \\v\\ replaced by 
(A(G) - 5{G)) ■{N-l) + {e{G) - 5{G)) ■ {2{N - 1) + ep{G)) . 

8 Discussion 

In this section, we discuss the relation to previous work on system and matrix transients and show 
how to apply our results to the analysis of the Full Reversal algorithm. In particular, we also obtain 
a new result on the transient of Full Reversal scheduling on trees. 
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8.1 Relation to previous work 



8.1.1 Even and Rajsbaum 

Even and Rajsbaum [4] proved an upper bound on the transient of xa,v for an irreducible matrix 
A G A4n,n{^ U {— oo}) and a vector v € M^. With our notation and G = G{A,v), their bound 
reads 

nf^, = lo{G) + N + 2N' , (21) 

where lo{G) is an upper bound on the length n of maximum weight paths that contain only non- 
critical nodes. It thus corresponds to our Bc{G) bound, and is given by, 

lo{G) = ^ + (A - 6) {N - 1)) +{N-1) , 

where f{G) is defined by 

/(G) = inf ^£{-f)g{G) - u;*(7) | 7 G Vo{G) A 7 is non-critical} . 
Since a path that has no critical nodes is non-critical, this can be bounded by 



f{G)^N.{g{G)-g,UG)) • 
Together with Corollary [1] it thus follows that, 

lo{G) ^ ll^ll + (A-^)-(iV-l) + (^r _ 1) ^ 5^(G) . (22) 

Q - Qac 

The N + 2N'^ term in ()2ip corresponds to the second term in the maximum of our explorative 
and repetitive bounds. Even and Rajsbaum extend realizers that contain critical nodes by adding 
a spanning Eulerian derivative (SED) of length 0{N'^) for each critical component visited by the 
original realizer. An SED is a closed path that visits each node in the critical component. They add 
SEDs because of the way they reduce paths: Their non-critical part construction may disconnect 
the original path by removing collections of critical edges that may be combined to a critical closed 
path. This is a major difference to our approach: While we, too, reduce realizers, our construction 
does not disconnect paths. 

With the SED construction Even and Rajsbaum can pump the length of the constructed path 
in multiples of c{Gc), by adding paths from the set of all elementary closed paths of all visited 
critical component, while still maintaining the property of being a realizer. The major difference 
to our approach here is that we pump the reduced realizers' length with either the (i) explorative 
method, or (ii) the repetitive method such that the resulting paths remain realizers, where the 
idea of both (i) and (ii) is that we extend the reduced realizers by adding a closed path at a single 
critical node whose subpaths are from a small restricted set of elementary closed paths of the node's 
critical component. In case of (ii) we even restrict the set of elementary closed paths, which are 
used for pumping, to a single elementary closed path the critical node lies on. 

Not resorting to the SED construction, we obtain upper bounds in which the critical path 
contribution may be linear in the number of nodes (cf. Section [8.31 below). 
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8.1.2 Hartmann and Arguelles 



Hartmann and Arguelles state the following bounds 

„HA=„,^jM±JLi^,2A'A (23) 

„HA ^ 2JV' . ^ , (24) 

Q- 

where q^{G{A)) is defined on the max-balanced reweighted graph [16j of graph G{A)^ in the follow- 
ing called Gmaxl^), as the supremum of g' € Umax such that the subgraph of Gniax(^) induced by 
the edge set of edges of Gmax(^) with weight at least g' has a strongly connected component with 
only non-critical nodes. In case = —oo, they set g — g^ = — 6{G). Note that the first term 

in (j23p corresponds to our Bc{G) bound, however, is incomparable with it in general. Hartmann 
and Arguelles reduce a realizer similar to Even and Rajsbaum, i.e., the reduced path may be dis- 
connected. To establish connectedness, they add at most N previously removed closed paths. They 
then add additional critical closed paths to arrive at the right residue class modulo c(Gc)- We have 
shown in Section 16.21 that this last step is, in fact, unnecessary and that the term 2N'^ in is 
therefore improvable to A^. A major difference of our bounds to ([23]) and (p^ is that ([23j) and ([2] 
cannot become linear in N. 



8.1.3 Soto y Koelemeijer 

Soto y Koelemeijer [TI] presented an upper bound on both the transient of system xa,v, in the 

following denoted by n^^, and the transient of matrix A, denoted by for irreducible A G 
A^7v,7v(lR'max) and V G R^. With our notation they read. 



' g- gi 



SyK_^_J ^,2.^_^ ^ , (26) 



"A 



Q- Qi 



where, by setting G = G{A), 



gi{G) = sup < I 7 G 'Po{G) A 7 is non-critical > . 

[ «(7) J 

We start our comparison with the bound n^^. By the argument that a path that has no critical 
nodes is non-critical, we obtain, gi{G) ^ gnc{G), and thereby, 

g{G) - gi{G) ^ giG) - gr,,{G) . (27) 

Thus the first term in (j25p is greater or equal to Bc{G). In contrast to the bounds stated in 
Theorems [U [6] and El the term 2 A^ in (I25p prevents the bound from potentially becoming linear 
in A. Further Corollary [5] shows that our upper bound is strictly less than the upper bound in ([25]) . 
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8.1.4 Matrix vs. system transients 

In contrast to Soto y Koelemeijer [11] and Hartmann and Arguelles [9], we proved the bound on 
the matrix transient ua by reduction to the system transient nA,vj for properly chosen v, shedding 
some Hght on how matrix and system transient relate. With this method we obtain the following 
bound from Corollaries [7] and El 

r,,, , 2(A-6) + (q-6)(N + 2) r 
UA < max <^ (iV - 1) • -i ^- '-^ '- , 



which is strictly better than the bounds and with respect to the second term, however, 
in general is incomparable to it with respect to the first term. By conservatively bounding ^3 ^ A, 
we see that our resulting bound on ua is close to the bound by Soto y Koelemeijer. Note 

that, however, our bound can become linear in N, since both i?m/s a.nd our bounds on nA,v can 
become linear in N. 

8.2 Integer matrices 

In the case that all weights of the nontrivial strongly connected e-weighted graph G are integers, 
we can derive a lower bound on the term q{G) — QnciG), which appears in all our upper bounds. 
Let N be the number of nodes in G. We show that 1/(^(G) — Qnc{G)^ is in 0{N^). This statement 
is trivial if Que (G) = -oo; so we assume that gnc{G) is finite. 

Let q{G) = x/y where x and y are coprime integers and y is positive. Then for every critical 
closed path 7, we have w^:{'^) / = x/y, i.e., y ■ tf*(7) = ^(7) • x. Because x and y are coprime, 
this implies that y divides ^(7). Hence y divides all critical closed path lengths, i.e., it divides their 
greatest common divisor gcd{c(i?) | H £ C{Gc)}- In particular, 

y ^ gcd{c{H) I H G C{G,)} . 

If QnciG) = z/u where z and u are coprime integers and u is positive, then necessarily u ^ 
crnc{G), where cr^ciG) is the maximum path length of elementary closed paths whose nodes are 
non-critical. Because q{G) — QnciG) > 0, we have 

X ■ u — z ■ y ^ 1 

Q{G) - Qnc{G) = ^ ^ 



y • u y ■ u 

which implies, by combining the above inequalities, that 

1 iV2 

-— — ^ y • ^ gcd{c{H) I H € C(G,)} • CTnciG) ^{N- Nnc) -Nnc^— ■ (28) 

g(Lr) — Qnc{'^) 4 

Combination with our bounds on ua^vi for constant \\v\\ and A — 5, thus yields nA^v = 0{N^). 
8.3 Full Reversal routing and scheduling 

Full Reversal is a simple algorithm on directed graphs used in routing [6] and scheduling [7]. It 
comprises only a single rule: Each sink reverses all its (incoming) edges. Given an initial graph Gq 
with N nodes, we define a greedy execution of Full Reversal as a sequence {Gt)t^o of graphs, 
where Gt+i is obtained from Gt by reversing the edges of all sinks in Gt- As no two sinks in Gt can 
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be adjacent, Gt+i is well-defined. For each t ^ we define the work vector W{t) by setting Wi{t) 
to the number of reversals of node i until iteration t, i.e., the number of times node i is a sink in 
the execution prefix Go, ... , Gt-i- 

Charron-Bost et al. [5] have shown that the sequence of work vectors can be described as a 
min-plus linear dynamical system: Define a min-plus matrix as a matrix with entries in Rmin = 
RU {+00}. We, analogously to max-plus, define the matrix multiplication 

{A ^' B)ij = mm{Ai^k + Bkj | 1 ^ ^ A^} . 

It is A eg)' i? = — (^{—A) (8) (— -B)), where {—M)ij is —Mij for matrix M. Generalizing a result by 
Charron-Bost et al. [5l Corollary 2], we obtain 

W{0) = {0,...,0) and - Wit + 1) = {-A) {-W{t)) , 

where 



if is an edge of Go 

1 if is not an edge of Go and is an edge of Go 
+00 otherwise . 



We distinguish two cases that differ in the initial graph Go: using Full Reversal as a routing 
algorithm, and using Full Reversal as a scheduling algorithm. 



8.3.1 Full Reversal routing 

In the routing case, the initial graph Go contains a nonempty set of destination nodes, which are 
characterized by having a self-loop. The initial graph without these self-loops is required to be 
weakly connected and acyclic. It was shown that for such initial graphs, the execution terminates 
(eventually all Gf are equal), and after termination, the graph is destination-oriented, i.e., every 
node has a path to some destination node [H [6] . 

In the following we specialize our bounds on the transient of a linear max-plus system to obtain 
bounds on the transient of {W{t))t^o, i.e., on the termination time 6{Gq) of greedy Full Reversal 
routing executions starting from inital graph Go. For that we define en- weighted graph G = 
G{—A,0) for the max-plus matrix —A obtained from initial graph Gq. Because —Ai^i = if i is a 
destination node, g{G) = 0. The set of critical nodes in G is equal to the set of destination nodes 
in Go and each critical component of G is trivial. Observe that —A is an integer max-plus matrix 
with Anc ^ and 6 = —1. Hence Qnc{G) ^ —1/N^c ^ ~ 1)) where N^c is the number of 

non-critical nodes in G. By Corollary [H 

B,{G) ^{N- 1)2 . 

Since for the critical components H of G, c{H) = g{H) = 1, we obtain from Theorem [3] and 
Corollary [21 an upper bound on the termination time of Full Reversal routing starting from initial 
graph Go, for ^ 3, is 

^(Go) ^ (iV - 1)2 , 

since the second term in the maximum in Bc{G) is at most 2(A^ — 1). 

If the undirected support of initial graph Gq without the self-loop at the destination nodes is a 
tree, we can use our bounds to give a new proof that the termination time of Full Reversal routing 
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is linear in [F, Corollary 5]. In that case it holds that q{G) = 0, and either Qnc{G) = —1/2 or 
Qnc{G) = —oo. In both cases we obtain from Corollary [H 

B,{G) ^ 2{N - 1) . 

In the same way as above, we obtain from Theorem [3] and Corollary O 

6{Go)^2{N-l) , 

which is linear in N. 

8.3.2 Full Reversal scheduling 

When using the Full Reversal algorithm for scheduling, the undirected support of the weakly 
connected initial graph Go is interpreted as a conflict graph: nodes model processes and an edge 
between two processes signifies the existence of a shared resource whose access is mutually exclusive. 
The direction of an edge signifies which process is allowed to use the resource next. A process waits 
until it is allowed to use all its resources — that is, it waits until it is a sink — and then performs a 
step, that is, reverses all edges to release its resources. To guarantee liveness, the initial graph Go 
is required to be acyclic. 

Contrary to the routing case, critical components have at least two nodes, because there are 
no self-loops. But it still holds that —A is an integer max-plus matrix with Anc ^ and 6 = —1. 
Hence, by using ([28]) and Corollary [H we get 

BAG) i , 



which, by using either Corollary [3l [H or [5] shows that the transient for Full Reversal scheduling is 
at most cubic in the number N of processes. This is an improvement over a result by Malka and 
Rajsbaum [IT] Theorem 6.4] who proved that the transient is at most in the order of N^. 

In the case of Full Reversal scheduling on trees, it holds that g = —1/2, and £»nc = — oo. Thus 
by Corollary m Bc{G) = 0. Further, Gc = G and c(G) = d{G) = g{G) = 2. Theorem [3] and 
Corollary [3] then imply, 

B,{G) ^ 6(iV - 3) . 

The resulting upper bound on the transient of Full Reversal scheduling on trees is hence linear 
in A^, which was previously unknown. 
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